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(54) High performance frame time monitoring system and method for a fiber optic switch for a 
fiber optic network 

(57) A frame time monitoring system (100) tracks 
the time in which data frames (11) reside within a fiber 
optic switch (30) for a fiber optic network. The network 
switch (30) transfers data frames (11) from source ports 
(33) to destination ports (33). The frame time monitoring 
system comprises a digital signal processor (DSP) 
(100a). which is configured by a software program (108) 
to implement a plurality of timers (164) relative to frames 
(11) to be routed through the switch (30) from a source 
port (33) to a destination port (33). The processor 
(100a) operates as an inaementer and is configured to 
output a series of sequential timer states (144) corre- 
sponding to each particular frame (11). The timer states 
(144) are generally indicative of the amount of time in 
which the frame (11) has resided in the switch (30). A 
logic network (100b) of logic gates is connected to the 
processor (100a) to receive and interpret the timer 
states (144). The logic network (100b) has frame busy 
(FBSY) and delete mechanisms (204. 207) for deter- 
mining elapse of respective FBSY and delete time peri- 
ods based upon the timer states (144). The FBSY and 
delete mechanisms (204, 207) generate respective 
FBSY and delete signals (146. 147) after the elapse of 
the periods, which can vary for optimization reasons 
depending upon frame class and type. Thus, in the fore- 
going configuration, a processor (100a) is utilized as a 
timing incrementer and logical decisions are allocated 
to the logic network (100b), resulting in an optimum tsat- 
ance between hardware and software so as to minimize 
cost, space requirements, and complexity, and maxi- 
mize frame tracking resolution. 
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Description 

RELD OF THE INVENTION 

5 The present invention generally relates to data communications and fiber optic networks, and more particularly, to 

a frame time monitoring system and method for tracking the time in which data frames reside within a fiber optic switch 
for a fiber optic network, while minimizing cost, space requirements, and complexity, and maximizing frame tracking res- 
olution {i.e., timer update frequency). 

10 BACKGROUND OF THE INVENTION 

A data communications network generally includes a group of interconnected communication channels which pro- 
vides intercommunicaftion among a combination of elements or devices, for instance, computers, peripherals, etc. His- 
torically, networks have been constructed by utilizing communication channels formed from coaxial cables and/or 

IS twisted pair cable configurations and interconnected via a suitable interface, or stvitching module. 

Fiber optic cables are increasingly being used in the network industry, instead of coaxial cables and twisted pairs, 
because of their much broader bandwidth, better propagation properties, and other optinrial transmission characteris- 
tics. Recently, the Fibre Channel protocol was developed and adopted as the American National Standard For Informa- 
tion Systems (ANSI). The Fibre Channel industry standard is described in detail in, for example. Fibre Channel Physical 

20 And Signalling Interface. Rev 4.2, American National Standard For Information Systems (ANSI) (1993). The Fibre 
Channel industry standard provides for much higher performance and greater flexibility than previous industry stand- 
ards by allowing for variable-length data frames, or packets, to be communicated through fiber optic networks which 
comply with the standard. 

A variable-length frame 11 is illustrated in Fig. 1. The variable-lengtii frame 11 conrprises a 4-byte start-of-frame 

25 (SOF) indicator 12, which is a particular binary sequence indicative of tiie beginning of the frame 1 1 . The SOF indicator 
1 2 is followed by a 24-byte header 1 4. which generally specifies, among other things, the frame source address and the 
destination address as well as whether the frame 1 1 is either control information or actual data. The header 14 is fol- 
lowed by a field of variable-length data 16. The length of the data 16 is 0 to 2112 bytes. The data 16 is followed succes- 
sively by a 4-byte CRC (cyclical redundancy check) code 17 for error detection and/or correction, and by a 4 byte end- 

30 of-frame (EOF) indicator 18. The frame 1 1 of Fig. 1 is much more flexible than a fixed frame and provides for higher 
performance by accommodating the specific needs of specific applications. 

The Fibre Channel industry standard also provides for several different types of data transfers and data frames. For 
example, a dass 1 transfer requires circuit switching, i.e., a reserved data path through the network switch, and gener- 
ally involves the transfer of more than one data frame, oftentimes numerous data frames, between the network eie- 

35 ments. To set up a class 1 transfer, a start-of-frame class 1 (SOFcl) frame, which is typically a small data packet, is 
initially passed through the switch, arxJ then after the set up, longer data frames are passed through the switch. As 
another example, a dass 2 transfer involves allocation of an independent path through the network switch for each 
transfer of a single frame from one network element to another. In a class 2 transfer, a receipt acknowledgement frame 
is sent from tfie destination port after receipt of the data frame. As still another example, a dass 3 transfer is similar to 

40 a class 2 transfer, except tiiat tiie class 3 transfer does not require a receipt acknowledgement frame from a destination 
port as in the case of a dass 2 ti-ansfer. 

To date, fiber optic switches for implementing networks in accordance with the Fibre Channel industry standard are 
in a state of infancy. A need exists in the industry for new and inproved systems for implementing the Fibre Channel 
industry standard for fiber optic networks with much higher performance than presentiy existing systems. Specifically, 

45 there is a significant need for a frame time monitoring system for monitoring the time in which a data frame resides 
witiiin a fiber optic switch. This timing information is important for optimizing performance because it indicates the ina- 
bility of the switch to successfully communicate the frame to the desired destination port and can be used to flag or insti- 
gate remedial action, such as deletion of the respective frame in the switch or return of tiie frame to its corresponding 
source port. To make the problem even more difficult and perplexing, the frame time monitoring system must be able to 

so keep track of numerous data frames simultaneously, typically hundreds at an instance in time, and must be able to 
update timing clocks associated with tiie frames within hundreds of microseconds (fis) to effectuate acceptable per- 
formance. Furthermore, space requirements and complexity in design are other primary considerations. 

It is possible that the frame time monitoring system could be implemented in software, which would be run by a con- 
ventional processor. However, such a solution would require a lengthy program due to tiie vast number of timers and 

55 logical comparison decisions and would therefore be undesirably slow and the timers would exhibit less than desirable 
resolution. Moreover, the frame time monitoring system could be implemented with a logic network made up of logic 
gates. Although this hardware implementation would undoubtedly be faster than the software implementation, the logic 
network would require numerous gates resulting in unacceptable cost and would require an undesirable amount of 
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space. Finally, both the aforementioned hypothetical softvyare and hardware implementations would be undesirably 
complex in design: 

SUMMARY QF THE INVENTION 

5 

An object of the present invention is to overcome the deficiencies and inadequacies of the prior art as noted above 
and as generally known in the industry. 

Another object of the present invention is to provide a high performance frame time monitoring system and method 
for a fiber optic switch. 

10 Another object of the present invention is to provide a frame time monKoring system and method for a fiber optic 
switch which provide for high resolution time monitoring. 

Another object of the present invention is to provide a frame time monitoring system and method which can track 
timing relative to numerous frames. 

Another object of the present invention Is to provide a frame time monitoring system which is inexpensive. 
75 Another object of the present invention is to provide a frame time monitoring system which is simple in design, 
which is efficient and reliable in operation, and which can be implemented in little space. 

Briefly described, the frame time monitoring system of the present invention tracks with high performance the time 
in which data frames reside within a fiber optic switch for a fiber optic network. The network switch transfers data frames 
from source ports to destination ports. The frame time monitoring system generally comprises a time processor, pref- 
20 erat>ly a digital signal processor, which is corrfigured by software to implement a plurality of timers relative to incoming 
frames which are to be routed through the switch from a source port to a destination port. The time processor operates 
as an incrementer and is configured to output a series of sequential timer states corresponding to each particular frame. 
The timer states are generally indicative of the amount of time in which the frame has resided in the switch. 

A time logic network of logic gates, which functions much faster than the time processor, is connected to the time 
25 processor to receive and interpret the sequential timer states. The time logic network has a delete mechanism for deter- 
mining elapse of a predetermined delete time period based upon the timer states. The delete mechanism generates a 
delete signal after the elapse of the predetermined delete time period. Thus, in the foregoing configuration, a processor 
is utilized as merely a timing incrementer and logical decisions are allocated to the logic network which is much faster 
than the processor. This configuration strikes an optimum t>alance between hardware and software so as to minimize 
30 cost, space requirements, and complexity, and to maximize frame tracking resolution (i.e., timer update frequency). 

Furthermore, the time logic network may be equipped with a frame return determination mechanism for determin- 
ing when a frame is returnable and nonreturnable to a source port. Moreover, when the frame is returnable, a frame 
busy (FBSY) mechanism determines elapse of a predetermined frame busy time period based upon the timer states. 
The FBSY mechanism generates an FBSY signal after the lapse of the FBSY time period. This FBSY signal triggers a 
35 sequence of events for returning the corresponding frame to its source port. 

Preferably, tiie delete time period and the busy time period are set for each frame to values which depend upon tiie 
particular class and type of frame in order to further optimize performance of the fiber optic switch. In other words, link 
control frames (e.^., acknowledge signals, reject signals, etc.) can be accorded longer delete and busy time periods 
than nonlink control frames (actual data) because accomnrKxiation of the link control frames effectively frees up the 
40 switch and enhances throughput. 

To further optimize the system, the timer states can define respective memory addresses for values for loading the 
timer. 

In addition to achieving all of the aforementioned objects, the present invention has numerous other advantages, a 
few of which are delineated hereafter. 

45 An advantage of the present invention is that various types of data frames can be accommodated. Specifically, 
frames which have a returnable frame are accorded an FBSY time period and can be returned. Furthermore, frame 
transfers which have nonreturnable frames are only accorded a delete time period and are not returned. Finally, the val- 
ues for the delete and FBSY time periods can be varied, depending upon the particular types of frames (e.^. SOFd . 
class 2 nonlink control, class 2 link control, class 2 busy and reject, dass 3, etc.). 

so Another advantage of the present invention is that because tiie processor is used solely as an incrementer, an inex- 
pensive processor, particularly a digital signal processor (DSP), can be utilized, while high resolution timing for numer- 
ous frames is still achieved. 

Another advantage of the present invention is tiiat the allocation of hardware and software resources optimizes per- 
formance, space requirements, and complexity. 
55 Another advantage of the present invention is that the design enables decrementing, or updating, of timers at least 
every 600 microseconds. 

Other objects, features, and advantages of the present invention will become apparent to one of skill in the art upon 
examination of the following drawings and detailed description. All such additional objects, features, and advantages 
are intended to be included herein within the scope of the present invention. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention can be better understood with reference to the following drawings. 

5 Fig. 1 1s a schematic diagram of a variable-length frame communicated through a fiber optic switch of a fiber optic 

network in accordance with the Fibre Channel industry standard protocol; 

Fig. 2 is a schematic circuit diagram of a fiber optic switch for a fiber optic network in accordance with the present 
invention; 

Fig. 3 is a schematic circuit diagram of a channel module (CM) within the fiber optic switch of Fig. 2; 
10 Fig. 4 is a schematic circuit diagram of a path allocation system within the fiber optic switch of Fig. 2; 

Fig. 5 is a schematic circuit diagram of a high performance frame time monitoring system of the present invention 
which is situated within the path allocation system of Figs. 2 and 4; 

Figs. 6A through 6C show data structures of information transferred to and from the frame time monitoring system 
of Fig. 5; 

15 Fig. 6A is a data structure for a source port and buffer identification (SPBNJD); 
Fig. 6B is a data structure for timer state identification (TMSJD); 
Fig. 60 is a data structure for a frame fonA^arding identification (FWD.ID); 

Fig. 7 is a memory map within the on-chip memory of the time processor of Fig. 5 for maintaining timers for each 

frame; 

20 Fig. 8 is a timeout value table for providing time values for the timers maintained in the time processor of Fig. 5; 

Fig. 9 is a logic block diagram illusti-ating the architecture and functionality of the time software program driving the 
time processor in the frame time monitoring system of Fig. 5; and 

Fig. 10 is a logic block diagram illustrating tiie architecture and functionality of the time logic network of Fig. 5. 

25 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

With reference now to the drawings wherein like reference numerals designate corresponding parts throughout the 
several views, a schematic circuit diagram of a fiber optic switch 30 is shown in Rg. 2. The fiber optic switch 30 enables 
implementation of a fiber optic network by permitting selective interconnection of a plurality of fiber optic channels 32. 
30 The fiber optic switch 30 is a very flexible system, permits both circuit and frame switching in accordance witii tiie Fibre 
Channel industry standard and is a much higher performance system than otiier conventional fiber optic switches. 

I. Fiber Optic Switch 

35 The fiber optic switch 30 has a plurality of channel modules 34 to which the fiber optic channels 32 are connected 
via respective ports (p1 -pi: sometimes called fabric ports, or F-ports) 33. Each channel nnodule 34 is connected to one 
or more of the fiber optic channels 32. Each channel module 34 provides port intelligence for data communication with 
the channels, as well as bypasses for class 1 data transfers and receive memory for temporarily storing data frames for 
class 2 and class 3 data transfers, as will be further described in detail later in this document. The channel modules 34 

40 are connected to a switch module 36. which receives and distributes electrical energy from a power supply 37. In the 
preferred embodiment, tiie switch module 36 is implemented as part of a back plane and has disposed thereon a 
number of functional interface elements. 

The switch module 36 has a status multiplexer (MUX) 41 which is configured to receive status signals from the 
channel modules 34 concerning the ports 33 and associated circuitry The status signals include at least the following: 

45 a "new frame arrived" signal, which indicates when a new frame has been received by a receive memory 84 (Fig. 3) 
associated with the channel module 34; a receiver ready, or "rxready" signal, which indicates when data received from 
a port 33 is ready and not ready to be sent through the switch 30 from the receive memory 84 (Fig. 3); an "Intermix bus 
ready" signal, which indicates when the IDN 44 Is ready (not being used) and not ready (currentiy being used) to trans- 
fer data; a "port active" signal, which indicates when a port intelligence mechanism 73 (Fig. 3) associated with a port 

50 33 is active/inactive; a "transmitter ready" signal, which indicates when a transmit memory 86 (Fig. 3) associated with 
a port 33 is ready and not ready to receive data (destined for a destination port 33) from the switch 30; an "intermix 
ready" signal, which indicates when the IDN 44 is ready and not ready to perform an intermix transfer; and a "transfer 
status ready." or "xfer ready." signal, which indicates when status information is ready and not ready to be transferred 
to ttie path allocation system 51 from the associated status/control logic 85 (Fig. 3) of a channel module 34. 

55 Referring again to Fig. 2. a main distribution network (MDN) 42 selectively interconnects the data paths of the chan- 
nels 32. An MND conta-oi bus 54 controls tiie MDN 42. A comrd distribution network (CDN) 43 communicates control 
signals to the various channel modules 34. An intermix distribution network (IDN) 44 selectively interconnects intermix 
paths between channel modules 34. Intermix paths are a set of alternate data paths which are separate from those data 
paths associated with the MDN 42 and which can permit data flow between selected channels 32 while data paths of 
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the MDN 42 are in use. Finally, a processor selector 45 can optionally be. provided as part of an auxiliary system for 
interconnecting processors and controllers distributed throughout the fiber optic switch 30. 

A path allocation system 51 is connected to the switch module 36 and, particularly, to the status multiplexer 41 . the 
MDN 42, the CDN 43, and the IDN 44. The path allocation system 51 generally allocates data interconnect paths 

5 through the switch module 36 and between fiber optic ports 33 and determines the priority of the connections. Signifi- 
carrtly, the path allocation system 51 includes a frame time monitoring system 100 which, because of its novel design, 
results in very desirable performance attributes with minimum space requirements and minimized complexity, as will be 
furtiier described in detaillater in this document. 

Also optionally connected to the switch module 36 is an element controller (EC) 58. The EC 58 essentially provides 

10 servers, for example, a name server, a time server, etc. for the interface system 30. The EC 58 has a data link 61 with 
the path allocation system 51 for communicating server information and a status/control connection 62 for exchanging 
status/control signals with the path allocation system 51 . The EC 58 exchanges initialization and/or configuration infor- 
mation with the CMS 34 and the microprocessor selector 45 via respective connection 64. Further, the EC 58 provides 
an embedded port, as shown in Fig. 2, for accessing frames in the fabric via the IDN 44 arid data connection 63. 

IS 

II. Channel Module 

Preferably, each of the channel modules 34 is constructed as indicated in the schematic circuit diagram of Fig. 3. 
With reference to Fig. 3, each channel module 34 comprises a port intelligence system 71 connected to a memory inter- 

20 face system 72. In the preferred embodiment, the port intelligence system 71 has one or more port intelligence mech- 
anisms 73. One port intelligence mechanism 73 is allocated to each fiber optic channel 32. Each port intelligence 
mechanism 73 has a receiver (RX) 74, a fransmitter (TX) 76, an optical link card (OLC) 75, and a status/confrol 
(STAT/CNTL) logic 85. The receiver 74 and the transmitter 76 are adapted to receive and transmit data, respectively, 
through their corresponding input and output fibers 79, 83 (shown collectively in Rg. 2 as channel 32) in accordance 

25 with the Fibre Channel industry standard j3rotocol and at the channel's particular bit rate. 

The OLC 75 Is utilized to directiy irrterfeice the port intelligence mechanism 73 to the fiber optic channel 32. The 
OLC 75 provides an optical-to-electi^ical conversion as well as a serlal-to-parallel conversion between the input fiber 79 
of the channel 32 and the receiver 74. Furthermore, the OLC 75 provides an electrical-to-optical conversion as well as 
a parallel -to-serial conversion between the output fiber 83 of the channel 32 and the transmitter 76. The OLC 75 can be 

30 any suitable conventional optical link card, for example but not limited to, a model OLC266 manufactured by and com- 
mercially available from IBM Corp., U.S.A.. or a model MIM266 manufactured by and commercially available from 
ELDEC, Inc., U.S.A. 

The status/control logic 85 monitors and controls both the receiver 74 and the transmitter 76. as indicated by cor- 
responding bidirectional control connections 87, 91. Further, the status/control logic 85 exchanges control signals on 

35 control connection 95 witii the CDN 43 (Fig. 2), provides status signals on connection 96 to the status MUX 41 (Fig. 2) 
indicative ot e.g., whettier the corresponding port 33 is available or busy, and fbnvards control signals to the memory 
interface system 72 via connection 97. The status/control logic 85 further recognizes when a new frame is received by 
the receiver 74 and determines the transfer class (eitfier 1 or 2) as well as the length of data pertaining to each new 
frame. It should be noted that a frame could have no data, as for example, in the case of an SOFcl frame, which is ini- 

40 tially passed through the switch 30 for setting the switch 30 up to reserve a bidirectional patii for a class 1 data transfer. 
The memory interface system 72 is connected in series, or cascaded, with the port intelligence system 71 , and par- 
ticularly, with each port irrtelligence mechanism 73 contained therein. The memory interface system 72 generally pro- 
vides class 1 bypass data connections 98, 99 for class 1 data transfers and provides temporary storage for class 2 and 
3 data transfers. For data storage relative to class 2 and 3 data transfers, the memory interface system 72 has a receive 

45 mmory (RX MEMORY) 84 for source data, a transmit memory (TX MEMORY) 86 for destination data, and memory 
control logic 88 for corrtrolling the receive and transmit memories 84, 86. The receive memory 84 and the transmit mem- 
ory 86 may be partitioned into a number of individual buffers or memory blocks, if desired. 

When incoming class 1 source data is received by the memory interface system 72 from the port intelligence sys- 
tem 71 , the source data bypasses tiie receive memory 84 via successively bypass data connection 98, MUX 66, and 

60 data connection 89. The data connection 89 introduces the source data to the data buses of the MDN 42 or the IDN 44 
of the switch module 36. The merrwry control logic 88 receives a tag 81 ' from the receiver 74 indicative of either a class 
1 or dass 2, 3 data transfer and controls the MUX 66 accordingly on class control connection 65. The receiver 74 gen- 
erates tiie tag 81* based upon the header 14 (Fig. 1) on tiie Incoming data. In the preferred embodiment, two-bit tags 
are used. A tag ''OO" indicates nonuse. A tag "Or Indicates data. A tag "10" indicates either SOF or EOF for a dass 1 

55 data transfer. A tag "1 1 " indicates either SOF or EOF for a dass 2 or 3 data transfer. 

When incoming class 2 or 3 source data is received by the memory interface system 72 (as well as an SOFcl 
frame), as is determined by the memory control logic 88 via tag 81', the receive memory 84 reads arKi stores the source 
data from the receiver 74 via data connection 81 under the control of the memory control logic 88. Moreover, when the 
timing is appropriate, the receive memory 84 writes data to tiie dafa buses of tiie MDN 42 or the IDN 44 of the switch 
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module 36 via data connection 67, MUX 66, and data connection 89 under the control of the control logic 88. In order 
to transfer data from the receive memory 84 to the data buses, the CDN 43 (Fig. 2) communicates a send control signal 
95 to the status/control logic 85, and the status/control logic 85 in turn fonwards a send signal via control connection 97 
to the memory control logic 88. The send signal from the status/control logic 85 designates the length of the data frame 

5 to be sent. Rased upon the send signal, the memory control logic 88 controls the receive memory 84 via control con- 
nection 92 and controls the MUX 66 with class control connection 65 so that the MUX 66 communicates data from the 
receive memory 84 to the data connection 89. K desired, the CDN 43 can also delete frames within the receive memory 
84 by sending a delete signal (del) to the status/control logic 85, which In turn forwards the delete command to the 
memory control logic 88 via control connection 97. 

10 Destination data intended for a destination port 33 from the data buses of the MDN 42 or the IDN 44 is made avail- 
able to the transmit memory 86. as indicated by data connection 94, and the MUX 69, as indicated by the bypass data 
connection 99. A two-bit tag on tag connection 94', similar to the two-bit tag on tag connection 81', informs the memory 
control logic 88 when the destination data corresponds to either a class 1 data transfer or a class 2, 3 data transfer. 
When dass 1 destination data is received, the memory control logic 88 controls the MUX 69 via control connection 68 

IS so that the MUX 69 channels the destination data directly to the transmitter 76 of the appropriate port intelligence mech- 
anism 73 via data connection 82. thereby effectively bypassing the transmit memory 86. In contrast, when class 2. 3 
destination data is received by the memory interface system 72, the memory control logic 88 controls the transmit mem- 
ory 86 to store the incoming destination data via data connection 94. When timing is appropriate, the destination data 
is then ultimately forwarded to the transmitter 76 of the appropriate port intelligence mechanism 73 via successively 

20 data connection 1 02. MUX 69. and data connection 82. under the control of the memory control logic 88. 

ill. Path AllQcatlon System 

A preferred embodiment of the path allocation system 51 of Fig. 2 is illustrated in detail in Fig. 4. As mentioned, the 

25 path allocation system 51 allocates the data paths through the switch nrxxlule 36. In architecture, the preferred embod- 
iment of the path allocation system 51 has the following elements, as is illustrated in Fig. 4. A sequencer 101 is con- 
nected to the CDN 43 via a control connection 103. A sentry 104 communicates to the CDN 43 via the control 
connection 106 and is connected to the sequencer 101 via the control connection 107. The glue logic 1 13 communi- 
cates control signals with the sentry 104 via the control connection 112, and communicates control signals to the 

30 sequencer 101 via the control connection 114. The novel frame time monitoring system 100 is constructed from a sep- 
arate time processor 100a and a time logic network 100b, which is situated within the glue logic 1 13 in the preferred 
embodiment. The frame time monitoring system 100 communicates to the sentry 104 and glue logic 1 13 via a control 
connection 111. The scheduler 118 maintains a plurality of destination queues (Qpi-Qpi) 121 which correspond respec- 
tively with each of the ports (pi -pi) 33. The scheduler 118 communicates with the glue logic 1 1 3 via connections 117. 

35 1 22. An arbitrator 1 23 is connected to the scheduler 1 1 8 via the connection 1 22. is connected to the glue logic 1 1 3 via 
the connection 1 16, is connected to the sequencer 101 via the connection 1 26, and communicates to the NDN 42 and 
IDN 44 via the data connection 124. A closer 128 monitors the sequencer 101 via the connection 129, receives control 
signals from the CDN 43 via the control connection 131 , and communicates to the sentry 104, the arbitrator 123. and 
an element controller (EC) interface 133 via the connection 134. The EC interface 133 communicates via a serial con- 

40 nection 135 with the element controller 58 (Fig. 2). 

A. Staty&Mix 

In addition to the control and data connections described in the previous paragraph, the status MUX 41 of Rg. 2 is 
45 connected to and communicates status signals to the sentry 104. the glue logic 1 13, the arbitrator 123. and the closer 
128. However, the foregoing connections are not shown in Fig. 4 for simplicity. 

B. Sequencer 

so The sequencer 101 can be implemented with any suitable logic, for example, as a state machine(s) in a conven- 
tional field programmable gate array (FPGA) with the functionality as set forth hereafter. The sequencer 101 serves as 
the primary interface to the CDN 43 via the control connection 103. It essentially arbitrates the CDN 43 among the sen- 
try 1 04, the arbitrator 1 23. and the closer 1 28. 

55 C. Sentry 

The sentry 104 can be constructed with any suitable logic, for example, as a state machine(s) in an FPGA. It mon- 
itors the new frame status ("new frame arrived" signal) of the ports 33 via the status MUX 41 (Fig. 2) and status/control 
logic 85 (Fig. 3) and determines when a new frame is available for routing through the MDN 42 of the switch module 36. 
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In essence, the sentry 104 collects data of validated, buffered frames, maps the destination port identification (DID) 
from the header (Fig. 1) of an incoming frame to an appropriate port 33 via a routing table(s), determines the appropri- 
ateness of a new frame for a destination port 33 {i.e., whether the frame can be intermixed onto a class 1 stream), and 
determines whether a new frame is proper or in error. 

5 The sentry 104 and frame time monitoring system 100. together, further provide queue command information to 

the scheduler 118, via the glue logic 113 and connections 1 12. 1 17. 122. The queue command information can Include 
an add signal, a frame busy (FBSY) signal, and a delete (del) signal. The add signal is sent when a new frame is within 
the receive memory 84 of the memory Interface system 72 and Is ready to be routed through the fiber optic switch 30. 
When an add signal is sent from the sentry 104 to the scheduler 118, the following information is sent: the add com- 

10 mand. the destination port (or queue), a link list tail pointer, a class indicator, the source port, source buffer number, and 
a link list head pointer 

The FBSY signal is sent when a new frame (returnable) has resided in the receive memory 84 for a predetermined 
time period (FBSY time period) which is considered too lengthy for the system. The FBSY signal which is sent by tiie 
frame time monitoring system 100 to the scheduler 118 generally includes the same information as the add signal, as 
15 delineated previously. 

The delete signal Is sent when a new frame (returnable and nonreturnable) has resided in the receive memory 84 
for another predetermined time period (delete time period), which is longer than the FBSY time period, and which war- 
rants deletion of the frame. A delete signal may also be issued for other error conditions. The delete signal which is sent 
by the frame time monitoring system 1 00 to the scheduler 1 1 8 includes the following patii data: (a) tiie delete command. 
20 (b) the source port, and (c) the source buffer numt)er. 

D. Frame Time Monitoring System 

The frame time monitoring system 100 measures the time in which a new frame resides within the receive memory 

25 84 of a channel module 32. It determines when a delete signal and If and when an FBSY signal should be asserted by 
the sentry 104. For this purpose, tiie frame time monitoring system 100 maintains internally a timer for each new frame 
for tracking the FBSY time period (returnable frames) and the delete time period (returnable and nonreturnable frames 
pertaining to each new frame. 

The frame time monitoring system 100 generally comprises a time processor 100a. preferably a digital signal proc- 

30 essor (DSP), which has an on-board (on-chip) memory 109, and a time logic network 100b in communication with tiie 
time processor 100a. The time processor 100a is configured by a time software program 108, which essentially com- 
prises a list of executable instructions, so tiiat a timer is maintained in the memory 109 for each frame to be routed 
through tiie switch 30. For initializing tiie timers, timer timeout values are stored In tiie memory 1 09. These timer timeout , 
values set ttie lengtiis of the particular frame busy and delete time periods corresponding with a frame. 

35 The time logic network 100b Is situated in the preferred embodiment within the same logic block as the glue logic 
113 and is constructed with any suitable logic, for example. FPQA. In general, the time processor 100a maintains and 
decrements a timer corresponding with each new frame, and the time logic network 100b interprets and decodes tiie 
timer states received from the time processor 100a. With this unique configuration, the time software program 108 driv- 
ing the time processor 1 00a can be sti'eamlined so that it can more easily handle numerous timers and with higher pre- 

40 cision (update frequency), while the decision making process is handled by the time logic network 100b. 

Fig. 5 illustrates more clearly the communication of control signals among the several elements of the frame time 
monitoring system 100. As shown in Fig. 5. the time software program 108 situated within the time processor 100a 
receives an initiate (INIT) signal 141 from tiie sentry 104 on connection 1 1 1 (Fig. 4) for starting the timer when a new 
frame Is ready to be received at a port 33. Upon receipt of the initiate signal 141 . the time processor 100a reads the 

45 following words from the sentry 104: (a) a source port and buffer number identification (SPBN_ID), a timer state identi- 
fication (TMS_ID). and a frame fbnwarding identification (FWDJD). The data structures for the SPBNJD, TMSJD, and 
the FWDJD are shown in Figs. 6A, 6B. and 6C. respectively When the scheduler 121 requests a frame by specifying 
the SPBNJD. the time processor 100a passes the TMS_ID and FWDJD to the scheduler 121 by way of the glue logic 
113. 

so As further shown in Fig. 5. the time software program 108 in the time processor 100a receives a timer clear (CLR) 
signal 142 from the arbitrator 123 for the purpose of clearing a timer. The timer clear signal is communicated via glue 
logic 1 13 (Rg. 4) and via connections 1 16. 1 1 1 (Fig. 4). As indicated by anrow 143 in Fig. 5, the time software program 
108 maintains and Increments a plurality of timers 164 (Tf^.Ttn), which con^espond respectively witii each frame to be 
routed through the switch 30 (Fig. 2) and which are stored in the on-board memory 109. The time software program 108 

55 communicates timer states corresponding with each timer to the remotely-situated time logic network 100b. as Indi- 
cated by reference arrow 1 44. The time logic network 100b interprets the timer states 1 44 and can output an FBSY sig- 
nal 146 and/or a delete signal 147 to the sequencer 101 and scheduler 118 after expiration of. respectively, an FBSY 
time period and a delete time period, provkiled tiiat no timer clear signal 1 42 has been received from the arbitrator 1 23. 
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Fig. 7 shows a preferred memory map 163 for the various timers 164 which are..stored in memory 109 of the time 
processor 100a. The SPBN_ID specifies an address within the memory map 163 of Fig. 7. In the preferred embodi- 
ment, up to 241 timers can be set up and maintained simultaneously Each timer 164 comprises a TMSJD 152 (Fig. 
6B). a time value 165. and an FWDJD 153 (Fig. 6C). The time value 165 is a binary number which is decremented by 

5 one (or by another binary number), eventually to zero, by the time software program 108 in the time processor 100a for 
the purpose of tracking time. Moreover, the TMS_ID 1 66 comprises a timer state 152a which indicates the current state 
of the time value 165. The timer state 152a is used by the time logic network 100b for determining when the FBSY and 
delete time periods have expired. 

Fig. 8 illustrates a timeout value table 171 from which delete and FBSY time values are retrieved for operating the 

10 timers 164 in Fig. 7. The timeout value table 171 is stored within the memory 109. The TMSJD spedfies an address 
within the timeout value table 1 71 of Fig. 8. The time values vary, depending upon the type of frame, as will be further 
clarified hereafter The frame type is indicated by reference numeral 177. Moreover, if a frame is returnable, both an 
FBSY and a delete time value are delineated, and if the frame is nonreturnable, only a delete time value is delineated. 
More specifically, for returnable frames, for example, an SOFcl frame as shown in Fig. 8. a time value 172 ("busy time 

IS - 1": /.e, binary number corresponding to busy time minus one increment) is provided for the FBSY time period and a 
time value 1 73 ("delete time - busy time - 1 ") is provided for the delete time period. For nonreturnable frames, for exam- 
ple, class 2 busy and reject frames (FRJT) as shown in Fig. 8. a time value 174 is provided for only the delete time 
period. 

Table A hereafter indicates which frames are returnable and which frames are nonreturnable. Further, it should be 
20 noted that the frame type is delineated in the data pertaining to a new frame, and specifically, in the TMSJD denoted 
by reference numeral 152a (in the memory map 163 of Fig. 7). 



TABLE A 



FRAME TYPE 


RETURNABLE 


SOFcl frames 


yes 


Class 2 non link control frames 


yes 


Class 2 link control frames (excluding FBSY, PBSY, FRJT. PRJT) 


yes 


Class 2 FBSY. PBSY. FRJT, and PRJT 


no 


Class 3 


no 



35 

In Table A. "FBSY" and "FRJT" mean frame busy and frame reject, respectively They refer to frames from the fabric 
(from within the switch 30). Further, "PBSY" and "PRJT" mean port busy and port reject, respectively These frames are 
received from an N-port (from a port 33) and are introduced into the switch 30. The contents of FBSY. FRJT, PBSY, and 
PRJT are defined in the ANSI fiber channel standard. 

40 By way of a logic block diagram, Fig. 9 illustrates the architecture and functionality of the logic implemented by the 
combination of the time software program 108 and the processor 100a. Each logic block in the diagram represents a 
module in the software of the program 108. While at each logic blocK the time software program 108 periodically 
causes the processor 100a to output from memory 109 the TMSJD (includes a timer state 152a in Fig. 6B) to the time 
Logic 100b. Tables B and C set forth hereafter indicate the encoding of timer states In the preferred embodiment for 

45 returnable and nonreturnable frames, respectively. These tables will be more fully described In relation to the logic block 
diagram of Fig. 9 hereafter. 



so 
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TABLE B 



IS 



Returnable Frames 


Timer state 


MEANING 


0 


New frame 


1 


N/A 


2 


Count down busy time 


3 


Busy timer timeout 


4 


Count down difference between busy time and discard time 


5 


Discard timer timeout 


6 


N/A 


7 


fM/A 


8 


Null 



TABLE C 



Nonreturnable Frames 


Timer state 


IMeaning 


0 


New Frame 


1 


N/A 


2 


Count down delete time 


3 


Delete timer timeout 


4 


N/A 


5 


N/A 


6 


N/A 


7 


N/A 


8 


Null 



With reference to Fig. 9. all empty logic block 1 76 serves as the starting and reset state of the logic block diagram. 
The logic block 176 indicates that the particular timer 164 (Fig. 7) does not have a time value 165 (Fig. 7) or has com- 

45 pleted a timing experience and is consequently reset. As indicated in Tables B and C. the timer state at this point is state 
8. If a frame is returnable, as indicated in Table A hereinbefore, then the logic block 1 76 transfers to a loop which could 
initiate both an FBSY signal and a delete signal, rf the frame remains in the switch 30 for their corresponding time peri- 
ods. If the frame is nonreturnable, then the logic block 176 transfers to a loop which can initiate only a delete signal, 
provided that the frame remains in the switch 30 for the specified time period. 

so More specifically, when the frame is returnable, the logic block 1 76 transfers to the logic block 1 77, where an FBSY 
time value is loaded into the timer 164 (Fig. 7) at reference numeral 165 (Fig. 7) for the particular frame. The timer state 
152a (Fig. 6B) is converted from state 8 to state 0 (Table B). In the preferred embodiment, the TMS_ID defines the 
memory address for the next FBSY value for loading the timer 164. Moreover, the FBSY time value depends upon the 
frame type indicated by reference numeral 177 in Fig. 8 (also listed in Table A). The FBSY time values, as well as the 

55 delete time values, are set to achieve optimum performance and frame throughput. As an example, link control frames 
can be set to have a greater FBSY time period and delete time period than nonlink control frames, because this config- 
uration can enhance throughput by freeing up the system. The time software program 108 retrieves the FBSY time 
value (e.g., 172 in Fig. 8) from the memory 109 (Fig. 5). 
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Once the timer 164 (Fig. 7) has been loaded with a new time value 165 (Fig. 7) from the timeout value table .163 
(Fig. 7). the logic block 1 77 transfers to a subloop comprising logic blocks 1 78, 1 79, 181 . While in the suWoop. the logic 
block 1 79 decrements the time value 1 65 (Fig. 7) of the timer 164 (Fig. 7) by one increment. One increment can be any 
number, but in the preferred embodiment, one increment corresponds to about 600 microseconds. After the decrement. 

5 the logic block 181 changes the timer state 152a (Fig. 6B) conesponding to the timer 164 from state 0 to state 2 (Table 
B). which indicates that the time software program 108 (and processor 100a) are now in the process of counting down 
the busy time period. The timer state 152a, set at state 2. is written to the time logic network 1 00b (Rg. 4) situated within 
the glue logic 113 (Fig. 4). The subloop will continue to decrement the time value 165 and write the timer state 152a to 
the time logic network 100b until the time value 165 is decremented to zero ("Izero" means not zero in Fig. 9). When 

10 the time value 165 reaches zero* the logic block 178 transfers to the logic block 188. 

At logic block 188, the time software program 108 changes the timer state 152a from state 2 to state 3 (Table B). 
In addition, a new delete time value corresponding to the frame type 152c (Fig. 6B) is retrieved from the timeout value 
table 1 71 (Fig. 7). Next, logic block 188 transfers to a subloop comprising logic blocks 191 , 192, 193. In the subloop. the 
logic block 192 decrements the delete time value by one increment. The Increment can be any number but in the pre- 

15 ferred embodiment corresponds to about 600 microseconds. After the decrement, the timer state 4 (Table B) is written 
to the time logic network 100b (Fig. 4). The delete time value is decremented until the time value 165 (Rg. 7) reaches 
zero, in which case logic block 191 transfers to logic block 194. 

At logic block 194, the timer state 152a is changed to state 5 (Table B) and the state is written to the time logic net- 
work 100b. Finally, after writing the timer state, the logic block 194 transfers back to the empty logic block 1 76 and the 

20 aforementioned process continues. 

When a frame is nonreturnable, the logic block 176 transfers to the logic block 196. At logic block 196. the timer 
state 152a is changed to state 0 (Table C). Moreover, a new delete value corresponding with the new frame is retrieved 
from the timeout value table 157 (Fig. 7). Next, logic block 196 transfers to a subloop comprising logic blocks 197, 198. 
and 199.. In the sut>loop. the logic block 198 decrements the delete value by one increment. The increment can con-e- 

25 spond to any number, but in the preferred embodiment corresponds to about 600 microseconds in terms of time. After 
the decrement, the timer state 152a set at state 2 (Table C) Is written to the time logic network 100b. as indicated in 
logic block 199. The subloop continues to decrement tiie delete value until it reaches^zero, in which case the logic block 
197 transfers to the logic block 201 . At logic block 201 . the timer state 152a (Fig. 6B) is changed from state 2 to state 3 
(Table C) and the foregoing timer state 152a is written to the time logic network 100b. After the foregoing, logic block 

30 201 transfers to logic block 1 76 and the aforementioned process continues. 

By way of logic block diagram. Fig. 10 illustrates tiie architecture and functionality of the time logic network 100b 
(Figs. 4. 5). In general, the time logic network 1 00b monitors the timer states 1 52a (Fig. 6B) received from the time proc- 
essor 100a and makes determinations based upon the timer states. Initially, as indicated in logic block 202, the time 
logic network 100b reads the frame type 174 and the timer state 152a from the TMS_ID (Fig. 9) from the time process 

35 100a. The logic block 202 transfers to tiie logic block 203, which determines whether the frame is returnable or nonre- 
turnable based upon the frame type 174. When the frame is retijrnable. the logic block 203 transfers to the logic block 
204. At logic block 204, the timer state 1 52a is examined. When the timer state indicates busy (state 3 in Table B), the 
logic block 204 transfers to the logic block 205. At logic block 205, an FBSY signal 146 (Fig. 5) is generated. When the 
timer state indicates delete (state 5 in Table B), then the logic block 204 transfers to the logic block 206, which generates 

40 a delete signal 147 (Fig. 5). After logic blocks 205. 206, the aforementioned process repeats. 

When the frame is determined to be nonreturnable at logic block 203, then the logic block 203 transfers to the logic 
block 207. At logic block 207, the timer state 152a is checked to determine whether tiie frame is to be deleted or not. 
When the timer state indicates delete {i.e. state 3 in Table C). tiien the logic block 207 transfers to logic block 208, which 
generates ttie delete signal 147 (Rg. 5). After logic block 208. the aforementioned process repeats witti the commence- 

45 ment of logic block 202 once again. In the alternative, when tiie timer state Indicates Idelete, then block 207 transfers 
back to logic block 202 and the process repeats. 

E. Glue Logic 

so The glue logic 113 primarily serves as an interface among the sentry 104. the frame time monitoring system 100. 
the sequencer 101. the arbitrator 123, and the scheduler 118. In the preferred embodiment, the glue logic 1 13 is imple- 
mented as a state machine(s) via a commercially availat>le FPGA or other suitable logic. The glue logic 113 also per- 
forms otiier functionality In the prefened enrtbodiment. The glue logic 1 1 3 monitors transmission ready (txready) signals 
and intermix ready signals through the sequencer 101 , which irxticate when a port intelligence mechanism 73 Is ready 

55 to receive a data frame. The glue logic 1 13 performs a circular sequence wherein it searches in sequence through 
those txready signals and intermix ready signals which are asserted, by masking out those which are deasserted, to 
determine the next destination port 33 which is to receive data (as well as the next destination queue 121 to service). 
The glue logic 113 fonwards tiie identity of the next destination port 33 to be serviced to the scheduler 1 18 via connec- 
tions 117. 122. In this regard, the glue logic 113 forwards a word to the scheduler 118 comprising a base pointer 



10 




EP 0 724 344 A2 



address, which identifies the heads of double link list queues, and a destination queue indicator, which identifies a par- 
ticular destination queue. 

F. Scheduler 

5 

The scheduler 118, which can be iniplemented with any convention processing mechanism, such as a DSP, main- 
tains and manages the destination queues (Qpi -Qp) 1 21 and receives the queue management commands, particularly, 
an add signal, an FBSY signal, and a delete signal, from the sentry 1 04. The scheduler 118 also receives a next desti- 
nation port signal via connections 1 17, 122, from the glue logic 113. The next destination port signal indicates the next 

10 port 33 to service (and hence, the next destination queue 121 to service). 

The scheduler 1 18 maintains and updates a destination queue (Qpi-Qpi) 121 for each of the fiber optic ports (pi- 
pi) 33 and is configured to store queue entries associated with each corresponding port 33. Each queue entry has path 
data which identifies the following: (a) source port 33 from which data is to be transferred from, (b) tiie source buffer 
number In receive memory 84 where the frame is located, and (c) flags which indicate whether the queue entry is a nor- 

15 mal frame entry, a frame for starting a class 1 data transfer ("SOFcl") entry, a Q-Head entry, or a Q-tail entry. Each of 
the queue entries Is related by a link list, preferak>ly a double or multiple link list, wherein each queue entry is associated 
witti a t>ackward link for designating a previous queue entry (via previous source port and buffer number) and a fontvard 
link for designating a subsequent queue enfry (via next source port and buffer number). The double link lists provkle an 
easy way to construct and manipulate queues, while minimizing hardware requirements. 

20 When the scheduler 118 receives patii daita pertaining to a new frame from a port intelligence mechanism 73 via 
an add signal from the sentry 104, the scheduler 118 stores the path data in an appropriate destination queue 121, 
along with a forward and backward link. 

When the scheduler 1 18 writes out data from the queues 121 . it does so in an order defined by the glue logic 1 13. 
Moreover, when the scheduler 118 writes out path data from a particular destination queue 121. the scheduler 118 

25 retrieves the queue entries from the destination queue 121 in an order defined by the link list associated ttierewith and 
then sends a request to transfer the new frame between the source port 33 and tiie destination port 33 to the arbitrator 
1 23, which in turn causes tiie switch module 36f to interconnect the appropriate data patii via the MDN 42 if tiie involved 
ports are ready 

When the scheduler 118 receives an FBSY signal con-esponding to a frame from the sentry 1 04, the scheduler 118 
30 takes tiie queue entry associated with the FBSY signal and moves the queue entry to the destination queue 121 con-e- 
sponding to the source port 33 where tiie data frame originated, so that the data frame is eventually returned to the port 
33 from which it came. 

When the scheduler 118 receives a delete signal corresponding to a frame, the scheduler 1 1 8 will delete the queue , 
entry associated witii the frame. Note that the frame which is deleted was previously put into the queue corresponding 
35 to the source port 33 where tiie frame originated by virtue of the FBSY signal from the sentry 104. 

G. Arbitrator 

The arbitrator 123 is implemented with any suitable logic, preferably with a state machine(s) implemented in a com- 

40 mercially available FPGA. The arbitrator 1 23 tracks the status of the port intelligence mechanisms 73. determines when 
the port intelligence mechanisms 73 are available and unavailable for transmitting and receiving data, and arbitrates 
connections between the port intelligence mechanisms 73. Specifically, the arbitrator 123 monitors transmission ready 
(txready). intermix ready, intermix bus ready, and receive ready (rxready) signals generated by the status/control logic 
85 (Fig. 3) of the port intelligence mechanisms 73. When the arbitrator 123 receives a transfer request signal from tiie 

45 scheduler 1 18 to transfer data from a particular source port 33 to a particular destination port 33. the arbitrator 123 
determines whettier the transfer Is either class 1 (circuit switching) or class 2 (frame switching). 

If a class 1 transfer is to be effectuated, then the arbitrator 123 determines if both the particular source port 33 and 
the destination port 33 are available for both transmitting and receiving data, because a class 1 transfer is bidirectional 
and requires a reserved data path through the switch 30. If a class 2, 3 transfer is to be effectuated, then the arbitrator 

so 1 23 determines whether the particular source port 33 is ready to transfer and whether the particular destination port 33 
is available for receiving a data frame. 

When the ports 33 are not ready to make the transfer (class 1,2.3), then the arbitrator 1 23 refuses the scheduler's 
transfer request, and the scheduler 118 revisits the transfer request later using any suitable algorithm, until the ti-ansfer 
request is ultimately granted. Once a transfer request has fc>een granted by the arbitrator 123. the arbitrator 123 controls 

55 the MDN 42 (Fig. 2) so that tiie MDN 42 connects the appropriate source port 33 to the appropriate destination port 33. 
Moreover, after or when the data transfer has been authorized by the arbitrator, the arbitrator 123 forwards a scheduler 
clear signal to the scheduler 1 18 so that the scheduler 1 1 8 eliminates tine associated queue entry from the coaespond- 
ing link list queue. The arbitrator 123 also fonwards a timer clear signal to the frame time monitoring system 100 in order 
to clear the timer's internal FBSY/del clock for the data frame being transferred. 
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H. Closer ^. 

The closer 128 is implemented with any suitable logic, but preferatrfy with a state machine(s) implemented in a 
commercially available FPGA. The closer 1 28 monitors the transfer status ready signals (xfer ready; indicates when sta- 

5 tus information is ready and not ready to be transfen^ed) corresponding with the ports 33 via connection 1 31 to the CDN 
43. The closer 1 28 interfaces to the sequencer 101 in order to execute CDN switch commands and to execute destina- 
tion port commands for a collection of status information. The closer 128 further collects frame statistics and delivers 
an increment count command to the EC interface 133. The statistics and increment count can be used by high level 
optimization algorithms to optimize, network performance and network management. 

10 The EC interface 133 is implemented with any conventional processing mechanism, such as a DSP. It interfaces 
the path allocation system 51 to the element controller 58 (Fig. 2) via a serial connection 135. The EC interface 133 
accepts commands from the element controller 58, builds packets from the commands, maintains and accesses the 
path allocation system's memory to execute read or write commands from the element controller 58. sends commands 
to the sentry 104 in order to change address validation table information, and sends commands to the frame time mon- 

15 itoring system 100 through the dedicated serial port 135. 

IV. Operation 

The overall operation of the fiber optic switch 30 with the novel path allocation system 51 wilt now be described with 
20 reference to Figs. 1 through 4 and, particularly, to a class 2 data ti-ansfer where a new data frame is routed through the 
fiber optic switch 30 and to a class 1 data transfer where a bidirectional reserved data path is established between ports 
33. 

Initially, a data frame is forwarded to the receive memory 84 of a channel module 32 from a source port (pi -pi) 33. 
The status/control logic 85 associated with the source port 33 outputs an rxready signal to the status MUX 41, which 
25 fonvards the rxready signal to the sentry 104. Based upon the rxready signal, the sentry 104 recognizes that a new 
frame is available and asks the sequencer 101 to request path data from the status/control logic 85 associated with the 
source port 33 from which the new frame was received. The path data includes a source identification (SID), a txjffer 
number indicating the location of the frame in receive memory 84, a destination port identification (DID), and a class 
indicator (class 1 or 2). 

30 In this regard, the sequencer 101 communicates a sequence of control commands to the CDN 43 in order to set 
up the CDN for causing the status/conf ol logic 85 associated with the source port 33 to fbnvard the path data corre- 
sponding to the new frame. The CDN 43 tiien causes the path data for the new frame to be transferred from the sta- 
tus/control logic 85 to the sentry 104. The sentry 104 validates tiie SID and maps the DID to a specific destination port 
33. If eitiier the DID or SID is invalid, a reject frame signal is queued in the status/control logic 85 instead of the frame 

35 itself. 

The sentry 104 informs Ixrth the frame time monitoring system 100 and the scheduler 1 18 of the presence of the 
new frame. The timer initiates tiie FBSY/del clock. Moreover, the sentry 104 sends an add signal to the scheduler 118. 
The scheduler 1 18 determines which destination queue to utilize based on the destination port indicator associated with 
the add signal from the sentry 104. A tail base pointer address in tiie add signal is utilized for accessing the tail of the 

40 particular destination queue, which is where the path data corresponding to the new frame is added. The scheduler 118 
uses the source port indicator, the source buffer number (in a receive memory 84), and class indicator to generate a 
queue entary in the particular destination queue, which is placed at the tail of the particular destination queue 121 . 

In the event that the FBSY time period expires at the frame time monitoring system 100 before the frame time mon- 
itoring system 1 00 receives the timer dear signal from the arbitrator 1 23. the frame time monitoring system 1 00 will fbr- 

45 ward an FBSY signal to the glue logic 113, which in turn will send an FBSY signal to the scheduler 1 18. At this point, 
the scheduler 1 18 takes the queue entry associated with ttie FBSY signal and moves the queue entry to the queue cor- 
responding to the source port 33 where the data originated, so that the data is eventually returned to the source port 
33 from which it came. 

If the predetermined delete time period expires at the frame time monitoring system 100 prior to tiie time that the 
50 frame time monitoring system 1 00 receives the timer dear signal from the arbitrator 1 23, then the frame time monitoring 
system 100 will forward a delete signal to the glue logic 113, which in turn will forward a delete signal to the scheduler 
1 18. At this point, the scheduler 118 will delete tiie queue entry associated witii the expired delete time period (which 
was previously put in the queue 121 con^esponding to the source port 33 of origination). 

As queue entries are introduced into tiie queues 121 by tiie scheduler 118, the scheduler 1 18 is also concurrently 
55 routing transfer requests to the arbitrator 123 for particular data connections and destination ports 33. The scheduler 
118 receives a next destination port signal from tiie glue logic 1 13. and accordingly, the scheduler 118 retrieves the 
queue entry at the head of the queue corresponding to the next destination port 33. The scheduler 118 then sends a 
transfer request to the arbitrator 123 corresponding to the retrieved queue entry. 
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The arbitrator 123 continuously monitors the status signals {e.g„ rxready. interniix ready, intermix txis ready, 
txready) from the source and destination port intelligence mechanisms 73 and determines whether the particular 
source and destination ports 33 are ready to exchange data. The arbitrator 123 determines whether the transfer is 
either class 1 or class 2. If class 1 . then the arbitrator 123 determines if both the particular source port 33 and the des- 

5 tination port 33 are available for both transmitting and receiving data, because a class 1 transfer requires a reserved 
path. If class 2. then the arbitrator 1 23 determines whether the particular source port 33 is ready to transfer (Le„ rxready 
for source port 33 is asserted) and whether the particular destination port 33 is available for receiving tiie new frame 
(/.e., bcready for tiie destination port 33 is asserted). 

When the ports 33 are not ready to make the frame transfer, then the arbitrator 1 23 refused the scheduler's transfer 

10 request, and the scheduler 118 revisits the transfer request later, until the transfer request is ultimately granted. 

Once a class 1 transfer request has been granted by the arbitrator 123. the arbitrator 123 configures the MDN 42 
so that the MDN 42 reserves a data path and connects the appropriate source port 33 to the appropriate destination 
port 33. Moreover, once a class 2 transfer request has been granted by the arbitrator 123, the arbitrator 123 configures 
the MDN 42 or the IDN 44 so that the new data frame is channeled from tiie receive memory 84 associated witii ttie 

IS source port 33 to the appropriate destination port 33. 

Upon the granting of a data transfer, the sequencer 101 informs the particular status/control mechanism 85 corre- 
sponding to the destination port 33 to expect data so tiiat the mechanism 85 can set up accordingly. The arbitrator 123 
also fonA^ards a scheduler clear signal to the scheduler 1 18 so that the scheduler 118 eliminates the associated queue 
entry from the corresponding destination queue, and also fonwards a timer clear signal to the frame time monitoring sys- 

20 tern 100 to dear the timer's internal FBSY/del clock corresponding to the frame. Moreover, after tiie frame time moni- 
toring system 100 clears its clock, the sequencer 103 fon^^ards a control signal to the status/control logic 85 associated 
witii the source port 33 to ultimately cause the receive memory 84 to fonward the new frame (or perhaps a frame rejec- 
tion signal) to tiie switch module 36 and then tiie destination port 33. 

The closer 1 28 finishes the frame fransfer by insuring that tiie transfer has occurred and by collecting the statistics 

25 on the transfer. The closer 128 requests the transfer status through the sequencer 101 regarding tiie transfer of tiie 
frame through the sequencer 101 . In turn, the destination port intelligence mechanism 73 advises the closer 1 28 of tiie 
status. The status information can include at least tiie following: CRC en^or. null frame, FBSY. reject frame (bad SID or 
DID), SOFd, intermix, and source port number. The closer 128 then instructs tiie EC interface 133 to increment a 
count, and the EC interface 1 33 increments the appropriate count. 

30 It will be obvious to those skilled in the art that many variations and modifications may be made to tiie preferred 
embodiment of the frame time monitoring system 100 and associated metiiodology as well as the fiber optic switch 30 
witiiout substantially departing from the principles of the present invention. All such variations and modifications are 
intended to be included herein within the scope of the present invention, as set forth in the following claims. 

35 Claims 

1 . A frame time monitoring system (100) for tracking with high performance the time in which data frames (11) reside 
witiiin a fiber optic switch (30) for a f ber optic network, the network switch (30) for transferring the data frames (1 1) 
from source ports (33) to destination ports (33), comprising: 
40 a processor (100a) configured to implement a timer (164) relative to an incoming frame (11) upon notifica- 

tion of receipt of said frame (11) by a source port, said processor (100a) configured to output sequential timer 
states (144); and 

a logic network (100b) connected to said processor (100a) to receive said timer states (144). said logic net- 
work (100b) comprising a delete means (204, 207) for determining elapse of a predetermined delete time period 
45 based upon said timer states (144). said delete means (204, 207) for generating a delete signal (147) after said 
elapse of said predetermined delete time period: 

whereby high performance is achieved by utilizing said processor (100a) as a timing incrementer and by 
allocating logical decisions to said logic network (100b) which is faster than said processor (100a). 

50 2. The system (1 00) of claim 1 , wherein said logic network (1 00b) further comprises: 

frame return determinatbn means (203) for determining when saki frame (1 1) is returnable and nonreturn- 
at)le to said source port; and 

frame busy means (204, 207) for determining elapse of a predetermined frame busy time period based upon 
said timer states (1 44) when said frame (1 1) is returnable, said frame busy means (204, 207) for generating a frame 
55 busy signal (146) after said elapse of said frame busy time period. 

3. The system (1 00) of claim 1 . wherein said processor (1 00a) is a digital signal processor (1 00a). 
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The system (100) of claim 1 . wherein said logic network (100b) is implemented in hardware with an integrated cir- 
cuit (100b) and wherein said timer (164) is implemented in software within said processor (100a). 

A frame time monitoring system (100) for tracking with high performance the time in which data frames (11) reside 
within a fiber optic switch (30) for a fiber optic networK the network switch (30) for transferring the data frames (11) 
from source to destination fiber optic channels (32), comprising: 

(a) a plurality of ports (33) corresponding respectively with said channels (32); 

(b) a memory means (84) associated with said ports (33), said menfK>ry means (84) for temporarily storing an 
incoming new data frame (11) from a source port (33); 

(c) a distribution network (42, 44) configured to interconnect said ports (33); 

(d) a sentry (104) in communication with said memory means (84), said sentry (104) configured to determine 
when said new data frame (121) has been received by said memory means (84); 

(e) a scheduler (1 18) which maintains a destination queue (121) corresponding with each of said ports (33), 
said scheduler (118) configured to receive path data (151) pertaining to said new data frame (121) from said 
sentry (104) after said sentry (104) determines receipt of said new data frame (121). said path data (151) 
including a source port indicator (151d). a memory address (151c. 151b) identifying a location of said frame 
(1 1) in said memory means (84), and a destination port indicator (155a), and said scheduler (118) configured 
to place said path data (151) within a destination queue (121) corresponding with said destination port (33) and 
to retrieve said path data (151) from said destination queue (121) based upon an order defined by said queue 
(121); 

(f) an arbitrator (123) configured to control said distribution network (42, 44) and to communicate with said 
scheduler (118). said arbitrator (123) configured to determine, after said arbitrator (123) receives a frame trans- 
fer request (122) from said scheduler (1 18), when said destination port (33) is busy servicing another frame 
transfer request (122) and when said destination port (33) is available for accommodating said frame transfer 
request (1 22). and said arbita-ator (1 23) configured to allow communication of said new data frame (1 2 1 ) to said 
destination port (33) via said distribution network (42, 44) when said destination port (33) is available and to 
disallow said frame transfer request (122) when said destination port (33) is busy; and 

(g) a frame time monitoring mechanism (100) configured to track time associated with said new data frame 
(121), said frame time monitoring mechanism (100) having: 

(1) a processor (100a) configured to implement a timer (164) relative to said new data frame (11), said 
timer (164) being initiated by said sentry (104) when said new data frame (1 1) is determined to exist witiiin 
said memory means (84). said processor (100a) configured to output timer states (144). said timer (164) 
being cleared via a clear signal (1 42) from said arbitrator (123) when said frame transfer request (122) cor- 
responding to said new data frame (121) is allowed; and 

(2) a logic network (100b) connected to said processor (100a) to receive said timer states (144), said logic 
network (100b) for communicating a delete signal (147) to said scheduler (118) after a predetermined 
delete time period unless said clear signal (142) is received from said arbitrator (123). 

The system (100) of claim 5. wherein said frame time monitoring mechanism (100) further comprises: 

frame return determination means (203) for determining when said frame (1 1) is returnable and nonreturn- 
able to said source port (33); and 

frame busy means (204, 207) for determining elapse of a predetermined frame busy time period based upon 
said timer states (1 44) when said frame (1 1) is returnable, said frame busy means (204, 207) for generating a frame 
busy signal (146) after said elapse of said frame busy time period. 

A frame time monitoring method (1 00) for tracking witii high performance the time in which data frames (11) reside 
within a fber optic switch (30) for a fiber optic network, the switch (30) for transfenring the data frames (11) from 
source ports (33) to destination ports (33). comprising tiie steps of: 

(a) implementing a timer (164) in software with a processor (100a); 

(b) commencing said timer (164) after receipt of a frame (1 1); and 

(c) passing timer states (144) from said timer (164) to a logic network (100b) in hardware, said logic network 
(100b) performing the following steps: 

(1) determining (204, 207) elapse of a predetermined delete time period teased upon said timer states 
(144): and 

(2) generating (206. 208) a delete signal (147) after said elapse of said predetermined delete time period. 
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8. The method of claim 7, wherein said logic network (1 00b) as recited In step (c) further performs the following steps: 

(3) determining (203) when said frame (11) is returnable and nonreturnable to said source port; and 

(4) determining (204, 207) elapse of a predetermined frame busy time period based upon said timer states 
(144) when said frame (11) is returnable, and when said frame (11) is returnaksle. generating a frame busy sig- 
nal (146) after said elapse of said frame tnjsy time period. 

9. The method of claim 7, further comprising the steps of: 

determining (176) a frame type corresponding with said frame (1 1); 
retrieving (1 88) a time value corresponding with said frame type; 
decrementing (1 91 , 1 92) said time value; and 

generating (193) said timer states (1 44) based upon a status of said time value. 

1 0. The method of claim 8, further comprising the step of specifying a plurality of frame busy time periods and a plural- 
ity of delete time periods corresponding with different frame types. 
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(54) High peilormance frame time monitoring system and method for a fiber o|9tic switch for a 
fiber optic networic 



(57) A frame time monitoring system (ICQ) tracks 
the time in which data frames (11) reside within a fiber 
optic switch (30) for a fiber optic network. The network 
switch (30) transfers data frames (11) from source ports 
(33) to destination ports (33). The frame time monitoring 
system comprises a digital signal processor (DSP) 
(100a). which is configured by a software program (108) 
to implement a plurality of timers (164) relative to frames 
(1 1) to be routed through the switch (30) from a source 
port (33) to a destination port (33). The processor 
(100a) operates as an incrementer and is configured to 
output a series of sequential timer states (144) corre- 
sponding to each particular frame (11). The timer states 
(144) are generally indicative of the amount of time in 
which the frame (11) has resided in the switch (30). A 
logic network (100b) of logic gates is connected to the 
processor (100a) to receive and interpret the timer 
states (144). The logic network (100b) has frame k)usy 
(FBSY) and delete mechanisms (204. 207) for deter- 
mining elapse of respective FBSY and delete time peri- 
ods based upon the timer states (144). The FBSY and 
delete mechanisms (204. 207) generate respective 
FBSY and delete signals (146, 147) after the elapse of 
the periods, which can vary for optimization reasons 
depending upon frame class and type. Thus, in the fore- 
going configuration, a processor (100a) is utilized as a 
timing incrementer and logical decisions are allocated 
to the logic network (100b), resulting in an optimum bal- 
ance between hardware and software so as to minimize 



cost, space requirements, and complexity, and maxi- 
mize frame tracking resolution. 
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